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[57] ABSTRACT 

/packets or cells received from different input ports of a 
switch and destined for a common output port of that 
switch, are analyzed to determine their priority level. 
Lower-priority packets or cells are buffered in recircu- 
lation delay lines of appropriately-selected lengths, and 
thereafter scheduled for transmission to the output port 
based on their level of priority. 
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thereafter are scheduled for transmission to the output 

CONTROLLED-FEEDB ACK PACKET SWITCHING ports based on their level of priority. 

SYSTEM In a specific example of the invention, a memoryless 

non-blocking switch is designed to include an input- 

TECHNICAL FIELD 5 /output section comprised of a certain number of input 

This invention relates to switching systems. More f°f* f d ou J? ul ^f 5 and » cert ^» number of recircu- 

specifically, this invention relates to the scheduling of ^ . dekv ^ of vanous If g^s ooniiected to dedi- 

packet deUvery in a switching system. cated input and output ports-for buffering packets. The 

switch also includes control circuitry that determines 

BACKGROUND 10 which packets need to be buffered in the recirculation 

Because of the unscheduled nature of arrivals of f d f Very gf the buffered 

packets or ATM cells to a packet switching system, two P*** 5 *^ d on their priority level. The control cir- 

or more packets may simultaneously arrive on different cmtrv ^ keeps packets in their proper first-m, first^ut 

inputs destined for the same output The switch archi- „ multiple -levels of priority traffic, 

tecture may allow one of these packets to pass through 15 ™ ? th , at P acke * P 888 ^ ou f. the ^circulation 

+ , ^ t A A « _ , r , - , .7 delay lines only a small number of times to minimize 

to the output, but the others must be queued for later 3 , 7~ ~r , " ^^^^ 

A _ • • n.- * ^ , . power losses, thereby avoidmg the need for optical 

transmissions. This temporary congestion caused by _ vr . * t , , . 6 " ' f." 

. u * i r i / » ■ * • ii i. amplifiers m the delay Imes in most cases. If amplifiers 

simultaneous arrival of packets or cells is typically nan- v , , j , it _ J V- -T 

, L -i * • , A . «, are used, a reduced number of lines through which a 

died by t^porariy stonng ^packets or cells in buff, 2Q ke{ ^ ^ proportional decrease in 

ers. For traffic distributions that are random or more or amplifier noise 

less uniform, buffering requirements are rather lenient ^ ^ rf ^ mvemio ket 
However, for high ^Performance packet switching sys- ^ fa partitioned into multiple; memoryless, 
terns designed to handle bursty traffic, the buffering non . blocking s ^ tches ^ „ either ^ onne cted to re- 
requirements are more strmgent 2 5 circulation delay lines or to the output ports of the 
For electronic packet switches, buffering is ordinar- ket sv/itchhl tem< ^ first ^ ^ f switches 
ily implemented in a random access memory (RAM) m calkd a « del line switc hes» whi i e & secon d are 
that is typically shared by aU the inputs and outputs of called M „ ou ^ ut switches „. Delay-line and output 
the switch m order to reduce memory storage require- switches m front . eild ed by routers which receive com- 
ments In opucal packet switches, the present lack of an ^ mands from a control to direct packets from 
optical random access memory significantly comph- ^ t ^ to either a de l a y-line switch when the pack- 
cates buffering m those optical switches. Approaches ets must be queued or t0 ail output switch when n0 
that have been considered for buffering m optical queuing is required, 
switches include an implementation that involves the 

routing of queued packets to trap lines that retard the 35 BRIEF DESCRIPTION OF THE DRAWING 

transmission of the queued input packets to the desired nG. 1 illustrates a packet switch designed in accor- 

output, thereby allowing other input packets destined with the invention to schedule delivery of lower- 

for the same output to be transmitted during the delay priority packets based on their priority level and to 

period. However, this approach presents certain draw- bu{fer pac kets in recirculation delay lines of appropri- 

backs that prevent its use in optical and optoelectronic ^ ately-selected lengths; 

packet switches. Specifically, certain scheduling func- F IG. 2 shows one example of a control table which 

tions needed for the orderly and timely switching and keeps track of packets in the recirculation delay lines of 

transmission of packets are not performed in the trap FIGS. 1 and 3- and 

line approach. For example, the trap line approach FIG. 3 shows an illustrative packet switching system 

(unlike the RAM approach) does not permit changes to 45 that is partitioned into multiple switches front-ended by 

the "scheduled" trarismission time of lower-priority routers, 
packets when higher-priority packets arrive later. 

Another approach that has been advocated for buff- DETAILED DESCRIPTION 
ering packets in optical switches is the so-called "feed- FIG. 1 illustrates an example of a packet switch 
forward" technique in which packets contending for an 50 which schedules delivery of packets based on then- 
output port are delayed by different numbers of time priority level. The packet switch of FIG. 1 also buffers 
slots to avoid collision with previously scheduled pack- lower-priority packets in recirculation delay lines of 
ets. In that approach, packets are dropped if they can- appropriately-selected lengths. FIG. 1 shows a block 
not be scheduled in a collision-free manner. This ap- diagram of a nXn packet switch comprising a) n input 
proach, however, does not allow transmission time to 55 lines 101-1 to 101-n b) n output ports 103-1 to 103-n c) m 
be updated on a slot-by-slot basis and does not ade- recirculation delay lines (of appropriately-selected 
quately support priority traffic. lengths) 105-1 to 105-m for buffering packets d) an 

Thus, there is a need for a packet buff ering system for (n+m)x(n+rn) memoryless, non-blocking switching 

use in optical and optoelectronic packet switches which block 102, and e) a control circuit 104 which reconfig- 

offers the same performance and functionality provided 60 ures the switching block 102 on a packet-by-packet 

by a RAM in electronic packet switches. basis. In FIG. 1, packets arrive at the input lines 101-1 to 

SUMMARY 101-n of the switching block 102. While switching block 

102 can be a strictly non-blocking switching block, it is 

This invention is directed to a packet switch in which preferably a rearrangeably non-blocking switching 

incoming packets or cells destined for a common output 65 block. For optical implementations, input lines 101-1 to 

port are analyzed to determine their priority level. 101-n may be fiber lines. When there is no contention 

Lower-priority packets or cells are buffered in recircu- for the output ports, packets received from input lines 

lation delay lines of appropriately-selected lengths, and 101-1 to 101-n are transmitted to the appropriate output 
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ports 102-1 to 102-n based on the packet headers that use optical logic gates to design such a circuit in an 

indicate the destination point for each packet. The optical implementation. 

header of a packet is read by control 104 which uses FIG. 2 shows one exemplary structure of a control 

power splitters 110-1 to 110-n to tap a small fraction of table which is arranged to keep track of packets in the 

the packet energy to read the header. To determine the 5 recirculation delay lines of FIG. 1 described above and 

appropriate configuration of the switching block 102, FIG. 3 described below. 

control 104 keeps track of all packets buffered in the In order to free control circuit 104 of FIG. 1 of the 
recirculation delay lines 105-1 to 105-m, so that it knows task of reading (for each tirae slot) the headers of all 
which packets will be returning to the switching block packets exiting the recirculation delay lines 105-1 to 
102 at what times. Control 104 may be implemented 10 105-m, control circuitry 104 maintains a table of infor- 
ming, for example, a microprocessor which executes mation about the packets stored in the recirculation 
prograrnming instructions described below. delay lines 105-1 to 105-m. FIG. 2 illustrates one possi- 

FIG. 1 shows that the recirculation delay lines 105-1 ble way for control 104 to store information about the 
to 105-m have lengths di, d2, . . . , and d m . The lengths buffered packets. As mentioned above, this information 
of those lines are expressed in units equal to the number 15 (e.g., the packets* output port addresses) is obtained by 
of packets that they respectively can store end-to-end. reading the packet headers when they First arrive to the 
In order to explain the interaction between switching switching block 102. This information is kept in the 
block 102, control 104 and recirculation lines 105-1 to control table of FIG. 2 until the packet exits the switch- 
105-m, it is assumed in this example, (without loss of ing block 102. In this example, the table of FIG. 2 is an 
generality, and for the sake of simplicity) that di^d2^. 20 mXd m table in an (electronic) RAM, that operates at 
. . =d m . For illustrative purposes, special attention is the packet rate and that is arranged to mimic the flow of 
devoted to the case in which di=l, d2=2, . . . , and packets through the recirculation delay lines 105-1 to 
d m =m. Since a total ofBA(d 1 +o , 2+ ... +d m )packets 105-m. Each row in the table corresponds to one of the 
can be stored in the recirculation delay lines 105-1 to m delay lines (m=8 in FIG. 2). Each column contains 
105-m, it follows that B=m(m+l)/2 when dj = l, 25 information corresponding to the set of packets that will 
d2=2, . . . , and d m =m. It is further assumed that exit the delay lines at the same time and arrive together 
switching block 102 and control circuit 104 use a time- for routing through the switching block 102. The time- 
slotted system in which, for each time slot, up to (n+m) slot pointer shown at the bottom of FIG. 2 cyclically 
packets may arrive at the switch (i.e., n new arrivals shifts to the left one column per time slot to indicate the 
plus m "recirculation packets"). Of these packets, up to 30 current set of (up to) m recirculation packets now re- 
n can be transmitted to their appropriate output ports; turning to switching block 102. The shaded portion of 
the rest are "buffered" in the recirculation delay lines the mXd m table corresponds to unused entries (for a 
105-1 to 105-m. A packet that is buffered in a recircula- given position of the time-slot pointer). When a packet 
tion delay line of length d/will exit that delay line and is buffered in a recirculation delay line, information 
return to switching block 102 after d/ time slots. Control 35 about that packet is moved in the control table of FIG. 
104 selects which packets to output for each time slot, 2 to the appropriate position along the "diagonal" (P14 
and also assigns the remaining packets to the recircula- for delay line 1, P25 for delay line 2, P36 for delay line 3, 
tion delay lines. More specifically, control 104 assigns . . . , or Ps3 for delay line 8). The amount of information 
packets to the appropriate delay lines in a way such that associated with each of these entries depends on the 
"buffer locations" in the delay lines are efficiently uti- 40 particular implementation of control 104, as illustrated 
lized, and packets retain their proper first-in, first-out by the following two examples, 
sequence, as needed. Control 104 also ensures that each In an illustrative non-FIFO (First-In First-Out) con- 
packet circulates through the delay lines 105-1 to 105-m trol implementation, the control 104 first routes as many 
only a small number of times. This last property is very of the packets to their outputs as possible for each time 
important, because it may help to keep the power losses 45 slot. In sequence, it considers the recirculation packets 
low enough to reduce, and perhaps eliminate, the need (beginning at the longest delay line and moving towards 
for optical amplifiers in the recirculation delay lines the shortest delay line), and then considers the new 
105-1 to 105-m. If amplifiers are needed in the recircula- packet arrivals. If there are multiple priorities, higher- 
tion delay lines 105-1 to 105-m, minimization of the priority packets are handled first. Whenever a packet 
number of recirculations helps keep the added noise 50 cannot be routed to its output port j (because another 
sufficiently small. In addition, if the power budget does packet has already been selected for routing to output 
indicate the need for amplifiers in the recirculation j), then the packet is sent to the shortest delay line that 
delay lines 105-1 to 105-m, the reduction in the number has the fewest packets destined for that output j "in that 
of lines translates into a valuable reduction in the num- column" of the Control Table of FIG. 2. Since at most 
ber of amplifiers. 55 one packet per output can be transmitted for each time 

It may be important to note that many different tech- slot, this last factor helps "load balance" the output 
nologies can potentially be used for an optical imple- addresses over the table's columns, 
mentation of the switch illustrated in FIG. 1. For exam- In an illustrative FIFO-control implementation, for 
pie, technologies such as guided-wave using lithium each time slot, the new packet arrivals and the recircu- 
niobate; or perhaps Wavelength Diversion Multiplexing 60 iation packets are either (i) routed to the appropriate 
(WDM) and star couplers; or even wavelength routers output ports for transmission, (ii) "scheduled" for trans- 
can be used to build such a switch. In addition, the mission after one more recirculation, or (iii) left "un- 
delay-line function that is performed in this example by scheduled" and sent to a delay line for another recircu- 
the recirculation delay lines 105-1 to 105-m can be im* iation. Each P^ entry in the control table keeps track of 
plemented using, for example, optical fiber lines or 65 (i) the input-output ports of each packet in the recircula- 
other appropriate optical transmission means. As to the tion delay lines, and (ii) whether or not the packet is 
control circuitry 104, it can more easily be implemented scheduled for transmission the next time it reaches the 
using a microprocessor even though it is also possible to switching block 102. There also is a FIFO table associ- 
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ated with each input-output pair. The FIFO keeps a splitting function that allows a control 307 to tap a small 

first-in, first-out list of all packets of this input-output fraction of a packet's energy to read that packet's 

pair, the exact location of these packets in the recircula- header. The packet switching system that is illustrated 

tion delay lines and in which (if any) future time slots in the block diagram of FIG. 3 shares some common 

they are scheduled for transmission. Finally, a "times- 5 elements with the packet switch shown in FIG. 1. For 

tamp" is given to each packet when it first arrives to the example, the packet switching system of FIG. 3 uses a) 

switching block 102. The timestamp corresponds to the the same set of recirculation delay lines shown in FIG. 

transmission time of an ideal output-queuing switch, 1, and b) a similar control* structure, albeit with a 

and represents the packet's "anticipated transmit time." slightly more distributed implementation. Thus, the 

Using this information about each packet, the Control 10 control table illustrated in FIG. 2 is readily applicable to 

schedules packets for transmission in the current time the modular design of FIG. 3. 

slot or future time slots. First, it routes any "scheduled As is the case for the switch of FIG. 1, the Control 
packets** on the recirculation delay lines to the appro- 307 is responsible for all routing decisions, including 
priate output ports. Second, it checks if any of the new deciding which delay lines buffer which packets. For 
arrivals can be routed to their outputs (without violat- 15 example, when multiple incoming packets destined for 
ing the FIFO constraint). Third, it schedules packets, if the same output port are received by routers 303 or 304 
possible, for transmission after their next recirculation from input lines 301-1 to 301-n, the headers of these 
(on the shortest possible delay line). A packet can be packets are read by control 307 which decides the 
scheduled only if the packet before it in its input-output proper treatment for the received packets using, for 
FIFO has already been scheduled. Priority in this 20 example, the scheduling techniques described above. As 
scheduling is given to packets with the smallest times- part of that decision, control 307 determines which 
tamp ("anticipated transmit time"), and to recirculation packet among the received packets to send to the appro- 
packets on the longest delay lines. .Once a packet is priate output port based on the priority level of the 
scheduled, this may also indirectly allow other packets packets. The selected packet to be routed to the output 
waiting in the same input-output FIFO to be scheduled 25 port is sent to MNSB 306 which promptly forwards that 
without violating the FIFO constraint. Finally, any packet to rear-end switch 309 or 310 via line 308. Rear- 
remaining packets are left unscheduled and are recircu- end switch is used in optical implementations of the 
lated to the delay lines. Starting with unscheduled pack- packet switching system of FIG. 3 to prevent energy 
ets having the smallest timestamp, packets are sent to loss that could result from the use of other types of 
the shortest delay Hue that has the fewest packets des- 30 devices. When a packet has to be buffered, control 307 
tined for that output in that column of the control table sends a signal to router 303 or 304 to forward that 
of FIG. 2. packet to MNSB 330 which in turn sends the packet to 

Other contention resolution schemes considered in- the delay line indicated by control 307. 
clude routing a packet to an output port (as opposed to Advantageously, buffering packets in the recircula- 
a recirculation delay line) based on the position of the 35 tion delay lines (105-1 to 105-m in FIG. 1 or 318-1 to 
input port from which the packet is received when that 318-m in FIG. 3) offers flexibility and efficiency not 
packet is contending for an output port with another possible with other techniques. For example, if first-in 
packet of equal priority level. Likewise, a packet re- first-out requirements dictate that an arriving packet 
ceived from a recirculation delay line dedicated input cannot be transmitted for at least k time slots (because 
port may be routed to an output port when another 40 other packets are queued for the same output), then, it is 
packet received simultaneously from a "regular" input advantageous to store that packet in a recirculation 
port is contending for the same output port. In that case, delay line of length k (if possible) and transmit that 
in accordance with the principles of the invention, the packet in due time. Even if the packet cannot be buff- 
other packet would be routed to a recirculation delay ered in a delay line of length k, "optimal performance" 
lifte- 45 may still be possible since there may be many combina- 

FIG. 3 shows an illustrative packet switching system tions of delay-line lengths that sum to k. For example, 

that is partitioned into multiple switches front-ended by an optimal (i.e., minimal) delay of 10 time slots can be 

routers. The modular design, illustrated in FIG. 3, parti- attained by buffering a packet in a delay line of length 

tions a packet switch into a "memory block" comprised 10, or by buffering it successively in delay lines of 

of memoryless non-blocking switching blocks (MNSB) 50 length 7 and 3, or successive delay lines of length 6, 1, 

306, 312, 314, and 330, delay lines 318-1 to 318-m, and and 3, etc. Furthermore, recirculation permits "schedul- 

an input/output section comprised of input lines 301-1 ing decisions" to be revised each time a packet returns 

to 301-n and output ports 340-1 to 340-n, respectively. to the switch from the feedback delay lines (e.g,, to 

In FIG. 3, the (n-fm)x(n+m) switch of FIG. 1 is allow for quicker transmission of new higher-priority 

configured as nXn, nXm, mXn, and mXm MNSBs, 55 packets), 

plus a number of routers 303, 304, 319, 320 and optional I claim: 

rear-end switches 309, 310, 316 and 317 for certain im- 1. A packet switching system comprising: 

plementations. at least one switching block having a plurality of 

The packet switching system that is illustrated in the input and output ports; 

block diagram of FIG. 3 includes routers 303, 304, 320 60 a control circuit for determining a) priority levels of 

and 319 that directs packets to either a delay-line packets received by the input ports and b) delivery 

MNSB, such as MNSB 314 (330) or an output MNSB time of packets to the output ports; 

such as MNSB 312 (306). Each MNSB is connected to a plurality of recirculation delay elements, each one 

n routers that receive incoming packets from input lines of which is connected to a dedicated input port and 

301-1 to 303-n or m routers that receive recirculated 65 a dedicated output port; and 

packets from recirculation delay lines 318-1 to 318-m. In means for buffering a lower-priority packet which is 

an optical implementation of the packet switching sys- contending for an output port with one or more 

temofFlG. 3, routers 303 and 304 also perform a power higher-priority packets, in a selected one of the 
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recirculation delay elements based on the priority 
level of the lower-priority packet as determined by 
the control circuit 

2. The invention of claim 1 wherein said buffering 
means comprises: 5 

means for routing the lower-priority packet to one or 
more recirculation delay elements until the lower- 
priority packet is no longer in contention for the 
output port with at least one higher-priority 
packet,* and 10 

means for keeping track of all packets routed to all 
recirculation delay elements. 

3. The invention of claim 2 further comprising: 
means for limiting the number of times a lower-pri- 
ority packet is routed to one or more recirculation 15 
delay elements. 

4. The invention of claim 1 wherein when two pack- 
ets of identical priority levels are a) received concur- 
rently from two separate input ports, and b) destined for 

a single output port, one of the two packets is arbitrarily 20 
chosen to be buffered in a selected recirculation delay 
element 

5. The invention of claim 1 wherein the recirculation 
delay elements have differing lengths and wherein a 
particular recirculation delay element is selected to 25 
buffer a packet based on the priority level of the packet 
and the length of the recirculation delay element. 

6. The invention of claim 5 wherein lower-priority 
packets are buffered in longer recirculation delay ele- 
ments and higher-priority packets are buffered in 30 
shorter recirculation delay elements. 

7. The invention of claim 1 further comprising 
means for keeping all packets routed to an output 

port of the switching block in a first-in-first-out 
sequence. 35 

8. Apparatus for use in a packet switching system 
comprising: 

means for determining the level of priority of incom- 
ing packets received from different input ports of 
the packet switching system and destined for a 40 
common output port of the packet switching sys- 
tem; 

means for routing the highest priority packet to the 
output port; 

means for buffering in selected ones of a plurality of 45 
recirculation delay lines lower-priority packets; 
and 



8 



means for scheduling delivery to the output port of 
the lower-priority packets buffered in lie recircu- 
lation delay lines based on their determined level of 
priority. 

9. The apparatus of claim 8 wherein the buffering 
means comprises: 

means for routing at least once the lower-priority 
packets to one or more -recirculation delay lines. 

10. The invention of claim 8 further comprising: 
means for limiting the number of times a lower-pri- 
ority packet can be routed to one or more recircu- 
lation delay lines. 

11. A method of routing packets in a switch compris- 
ing: 

determining levels of priority of incoming packets 
received from different input ports of the switch 
and destined for a common output port of the 
switch; 

routing the highest priority packet to the output port; 

buffering in selected ones of a plurality of recircula- 
tion delay lines lower-priority packets; and 

scheduling delivery to the output port of the lower- 
priority packets buffered in the recirculation delay 
lines based on their determined level of priority. 

12. A packet switching system comprising: 

a switching fabric having at least one switching block 
with a plurality of input and output ports; 

a plurality of recirculation delay elements, each one 
of which is connected to a dedicated input port and 
a dedicated output port of the switching fabric; 

a control circuit for a) determining levels of priority 
of packets received from the input ports, and b) 
selecting one of the recirculation delay elements 
through which, one or more lower-priority packets 
contending for one of the output ports with one or 
more higher priority packets is returned to the 
switching fabric at least once. 

13. The invention of claim 12 further comprising: 
means for routing a packet to an output port when the 

packet is in contention for the output port with 
another packet of equal priority level. 

14. The invention of claim 12 further comprising: 
means for routing a packet to an output port based on 

the position of the input port from which said 
packet is received when said packet is in contention 
with another packet of equal priority level. 
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